Sonification of Sculler Movements, Development of Preliminary Methods
نویسندگان
چکیده
Sonification is a widening field of research with many possibilities for practical applications in various scientific domains. The rapid development of mobile technology capable of efficiently handling numerical information offers new opportunities for interactive auditory display. In this scope, the SONEA project (SONification of Elite Athletes) aims at improving performances of Olympic-level athletes by enhancing their training techniques, taking advantage of both the strong coupling between auditory and sensorimotor systems, and the efficient learning and memorizing abilities pertaining the sense of hearing. An application to rowing is presented in this article. Rough estimates of the position and mean velocity of the craft are given by a GPS receiver embedded in a smartphone taken onboard. An external accelerometer provides boat acceleration data with higher temporal resolution. The development of preliminary methods for sonifying the collected data has been carried out under the specific constraints of a mobile device platform. The sonification is either performed by the phone as a real-time feedback or by a computer using data files as input for an a posteriori analysis of the training. In addition, environmental sounds recorded during training can be synchronized with the sonification to perceive the coherence of the sequence of sounds throughout the rowing cycle. First results show that sonification using a parameter-mapping method over few quantities can provide a meaningful sound feedback.
منابع مشابه
Sonification of Facial Actions for Musical Expression
The central role of the face in social interaction and non-verbal communication suggest we explore facial action as a means of musical expression. This paper presents the design, implementation, and preliminary studies of a novel system utilizing face detection and optic flow algorithms to associate facial movements with sound synthesis in a topographically specific fashion. We report on our ex...
متن کاملMethods for effective ancillary gesture sonification of clarinetists
Through advanced recording and simulation possibilities the amount of 3D movement data is constantly growing. This data type stems from different origins ranging from sports, HCI and music research (body movements and gestures). Although these data sources look at first glance very disparate, they are in fact structurally very similar since they represent dynamic processes in 3D space with many...
متن کاملA Sonification Tool for the Analysis of Large Databases of Expressive Gesture
Expert musical performance is rich with movements that facilitate performance accuracy and expressive communication. Studying these movements quantitatively using high-resolution motion capture systems has been fruitful, but analysis is arduous due to the size of the data sets and performance idiosyncrasies. Compared to visual-only methods, sonification provides an interesting alternative that ...
متن کاملEvaluation of a Multimodal Sonification and Visualisation of Depth of Market Stock Data
Day traders make minute by minute decisions from depth of market stock data read from a table. A visualisation has been designed to help traders make better decisions from extra context and history in the display. An expert review of the visualisation identified the need for more dynamic information and higher resolution in critical areas. We designed a sonification to complement the visualisat...
متن کاملPerceptual Effects of Auditory Information about Own and Other Movements
In sport accurate predictions of other persons’ movements are essential. Former studies have shown that predictions can be enhanced by mapping movements onto sound (sonification) and providing audiovisual feedback [1]. The present study investigated behavioral mechanisms of movement sonification and scrutinized whether effects of own movements and those of other persons can be predicted just by...
متن کامل